ReactiveMP.jl: A Julia package for reactive variational Bayesian inference

Variational Bayesian Inference Note

When we use EM that uses maximum likelihood as a criterion to select the number of Gaussians, we face the problem of that as the complexity of model increases, the training likihood strictly improves, which means the larger number of Gaussians, the better fit of the training data (see Figure 1). We can see from this example, the traning log-likelihood can even become positive when some clusters...

Variational Inference for Nonparametric Bayesian Quantile Regression

Quantile regression deals with the problem of computing robust estimators when the conditional mean and standard deviation of the predicted function are inadequate to capture its variability. The technique has an extensive list of applications, including health sciences, ecology and finance. In this work we present a nonparametric method of inferring quantiles and derive a novel Variational Bay...

Collapsed Variational Bayesian Inference for PCFGs

This paper presents a collapsed variational Bayesian inference algorithm for PCFGs that has the advantages of two dominant Bayesian training algorithms for PCFGs, namely variational Bayesian inference and Markov chain Monte Carlo. In three kinds of experiments, we illustrate that our algorithm achieves close performance to the Hastings sampling algorithm while using an order of magnitude less t...

Variational Bayesian Inference for Financial Models

Variational Bayesian Inference for Partially Observed Diffusions

In this paper the variational Bayesian approximation for partially observed continuous time stochastic processes is studied. We derive an EM-like algorithm and give its implementations. The variational Expectation step is explicitly solved using the method of conditional moment generating functions and stochastic partial differential equations. The numerical experiments demonstrate that the var...